1 APPARATUS AND METHOD FOR INCREASING A DIGITAL CAMERA 




2 IMAGE CAPTUR E RATE BY DELAYING IMAGE PROCESSING 

3 



4 \% W .CROSS-REFERENCE TO RELATED APPLICATIONS 

5 This application relates to co-pending U.S. Patent Application Serial 

6 No. 08/355,031, entitled "A System and Method For Generating a 

7 Contrast Overlay as a Focus Assist for an Imaging Device," filed on 

8 December 13, 1994, and also relates to co-pending U.S. Patent 

9 Application Serial No. 08/588,210, entitled "Apparatus and Method for 

* 

10 Rotating the Display Orientation of a Captured Image," filed on January 

11 19, 1996. 
12 

13 BACKGROUND OF THE INVENTION 

14 1 . Field of the Invention 

15 The present invention relates generally to a method and 

16 apparatus for managing digital image data. More particularly, the 

17 present invention is an apparatus and method for increasing the 

18 image capture rate of a digital camera by delaying image processing 

19 and compression. 
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2. 



Description of the Background Art 



2 



Still-cameras are often required to capture images at rates 



3 which vary depending on their selected photographic targets. For 

4 example, during a fast-moving sporting event, still-cameras may be 

5 required to capture a series of images during a relatively short time 

6 period. Thus, an important still-camera performance feature is the 

7 capture rate for successive sets' of image d^ta. 

8 Another important still-camera performance feature is the 

9, number of captured images that can be stored in the camera's finite 

10 memory. To maximize the image-carrying capacity of digital still- 

11 cameras, it is desirable to compress the images prior to storage. 

12 Conventional digital cameras typically perform image processing on 

13 the raw image data and then use a high-quality image compression 

14 routine (such as JPEG) to compress the image data. 

15 Photographers, however, may want to capture another image 

16 before the camera has completed the time-consuming image 

17 processing and compression of raw image data. Therefore, the above 

18 processing and compression technique can effectively lower the 

19 successive image capture rate. 
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One common approach for minimizing the image processing and 



2 compression time is through the use of custom-designed Application 

3 Specific Integrated Circuits (ASICs). Typically, up to three relatively 

4 expensive ASICs may be required to perform the image processing 

5 and compression operations. While such ASIC-based cameras perform 

6 the required image processing and compression operations very 

7 quickly, their increased cost may render such cameras less attractive 

8 to the mainstream consumer market. 

9 To make the digital cameras more affordable, manufacturers have 
10, replaced many of the costly ASICs with functionally equivalent software- 

11 based routines. The software-based routines may be stored within 

12 standard ROM chips and they can also be readily updated by rewriting a 

13 portion of the software. Software-based cameras, however, typically 

14 require an inordinately long time to perform the image processing and 

15 compression operations. This results in slower successive image capture 

16 rates and limits the marketability of the software-based digital still- 

17 cameras. 

18 Therefore, what is needed is an apparatus and method that 

19 enables a relatively low-cost, software-based digital camera to attain 

20 higher successive image capture rates. 
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SUMMARY OF THE INVENTION 



2 



The present invention is a method and apparatus for increasing 



3 the image capture rate of a digital camera by delaying image 

4 processing and compression of the captured image data. In the 

5 present invention, an imaging device captures an image in response to 

6 an image capture request and responsively produces corresponding 

7 raw image data which is temporarily stored into a frame buffer. 

8 A first RAM spooler then typically transfers the raw image data 

9 to a RAM disk. A first flash spooler next transfers the raw image data 
1Q from the RAM disk to a flash memory which preferably is a 

11 removable flash disk. An image processor processes and compresses 

12 the raw data and may directly store the compressed data to the RAM 

13 disk, or alternately, a second RAM spooler may store the compressed 

14 image data into the RAM disk. A second flash spooler then transfers 

15 the compressed image data from the RAM disk to the flash memory. 

16 The present invention uses a set of priorities designed to 

17 maintain the frame buffer in a condition to receive new image data 

18 from the imaging device. Therefore, spooling raw data from the frame 

19 buffer to the RAM disk has the highest priority, spooling raw data 

20 from the RAM disk to the flash memory has the second highest 
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1 priority, processing and compressing the raw data from the flash 

2 memory has the third highest priority, spooling the compressed data 

3 into the RAM disk has the fourth highest priority, and spooling the 

4 compressed data from the RAM disk to the flash memory has the 

5 lowest priority. 
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1 BRIEF DESCRIPTION OF THE DRAWINGS 

2 1 Figure ^l^i-s^a block diagram showing a preferred embodiment of 

3 arv apparatus for increasing a digital camera image capture rate by 

4 delaying image processing; 

/ 

5 Figure 2 is a block diagram showing a preferred embodiment of 

6 an imaging device according to the present invention; 

7 Figure 3 is a block diagram showing a preferred embodiment of 

8 ' a computer- of the present invention; 

9 Figure 4 is a block diagram showing a preferred embodiment of 

10 a Random Access Memory (RAM) of the Figure 3 computer; 

11 Figure 5 is a block diagram showing a preferred embodiment of 

12 a Read Only Memory (ROM) of the Figure 3 computer; 

13 Figure'^ls^ a block diagram showing a preferred embodiment of 

14 an apparatus for increasing a camera image capture rate according to 

15 the present invention; 

16 Figure 7 is a block diagram showing priority levels of preferred 

17 processes and corresponding image data paths; 

/ 

18 Figure 8 is a flowchart of preferred method steps for 

19 implementing RAM Spooler 1 of the present invention; 
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1 Figure^9/i<^a flowchart of preferred method steps for 

2 implementing the Flash Spooler 1 of the present invention; 

3 Figure 1 O^is^ flowchart of preferred method steps for 

4 implementing the Image Processing/Compression of the present 

5 invention; 

6 Figure 11 is a flowchart of preferred method steps for 

7 implementing the RAM Spooler 2 of the present invention; and 

8 Figure 12 is a flowchart of preferred method steps for 

9 implementing the Flash Spooler 2 of the present invention. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 



2 



The present invention comprises an apparatus and method for 



3 increasing the successive image capture rate of a digital camera and 

4 features a series of priority levels, the highest of which maintains the 

5 apparatus in a ready state for capturing multiple sets of raw image 

6 data. Recently captured raw images are temporarily diverted to a 

7 memory device and the time-intensive software-based image 

8 processing and compression operations are postponed until after the 

9 apparatus has stopped capturing additional sets of image data or until 
10. processor time becomes available. During a time when the apparatus 

11 is no longer capturing additional sets of image data, the present 

12 invention advantageously performs the image processing and 

13 compression operations. As a result, the time delay between 

14 successive image captures is greatly reduced. 

( 15 Referring now to Figure 1, a block diagram of a preferred 

16 embodiment of apparatus 10 for increasing an image capture rate is 

17 shown. Apparatus 10 may be used to capture a set of image data 

18 representing an object 12. Apparatus 10 preferably comprises an 

19 imaging device 14, an external bus 16 and a computer 18. Imaging 

20 device 14 is optically coupled to object 12 and electrically coupled via 
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1 external bus 16 to computer 18. Once a photographer has focused 

2 imaging device 14 on object 12 and, using a capture button or some 

3 other means, instructed apparatus 10 to capture an image of object 



5 capture raw image data representing object 12. The captured raw 

6 image data is transferred over external bus 16 to computer 18 which 

7 performs various image processing functions on the image data before 

8 storing it in its internal memory. External bus 16 also passes various 

9 status and control signals between imaging device 14 and computer 



12 embodiment of imaging device 14 is shown. Imaging device 14 

13 preferably comprises a lens 20 having an iris, a filter 22, an image 

14 sensor 24, a timing generator 26, an analog signal processor (ASP) 28, 

15 an analog-to-digital (A/D) converter 30, a digital signal processor 

16 (DSP) 40, and one or more motors 32. 

17 U.S. Patent Application Serial No. 08/355,031, entitled "A 

18 System and Method For Generating a Contrast Overlay as a Focus 

19 Assist for an Imaging Device," filed on December 13, 1994 is 

20 incorporated herein by reference and provides a detailed discussion of 



4 12, computer 18 commands imaging device 14 via external bus 16 to 



10. 18. 
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Referring now to Figure 2, a block diagram of a preferred 
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1 the preferred elements of imaging device 14. Briefly, imaging device 

2 14 captures an image of object 12 via reflected light impacting image 

3 sensor 24 along optical path 34. Image sensor 24 responsively 

4 generates a set of raw image data representing the captured image 12. 

5 The raw image data is then routed through ASP 28, A/D converter 30 

6 . and DSP 40. DSP 40 has outputs coupled to lines 35, 38 and 42 for 

7 controlling ASP 28, motors 32 and timing generator 26. From DSP 40, 

8 the raw image data passes over external bus 16 ,to computer 18. 

9 Referring now to Figure 3, a block diagram of a preferred 

10. embodiment of computer 18 is shown. Computer 18 comprises a bus 

11 interface 52, a processing unit 54, a read-only memory (ROM) 56, an 

12 input device 58, a random access memory (RAM) 60, an I/O interface 

13 62, a flash memory 64 and a non-volatile memory 68 coupled 

14 together via an internal bus 66. In the preferred embodiment, 

15 computer 18 is embedded as part of apparatus 10 using a 

16 conventional architecture. However, those skilled in the art will 

17 recognize that in an alternate embodiment, computer 18 may be a 

18 discrete computer system. 

19 Bus interface 52 is preferably a bi-directional first-in, first-out 

20 interface for receiving the raw image data and imaging device 14 control 
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1 signals passed between computer 18 and DSP 40. Interface 52 has data 

2 lines coupled to both external bus 16 and internal bus 66. Processing 

3 unit 54 executes programming instructions stored in ROM 56 and RAM 

4 60 to perform various operations. ROM 56 stores a set of computer 

5 readable program instructions which control how processing unit 54 

6 accesses, transforms and outputs the image data. While ROM 56 is 

7 employed as a conventional non-volatile memory device for practicing 

8 the present invention, those skilled in the art will recognize that in 

9 alternate embodiments ROM 56 could be replaced with a functionally 
10. equivalent computer useable medium such as a compact disk and drive, 

11 a floppy disk and drive, or a flash memory. 

12 Input device 58 preferably comprises a series of control buttons 

13 which generate signals translated by processing unit 54 into an image 

14 capture request, an operating mode selection request, and various 

15 control signals for imaging device 14. In an alternate embodiment in 

16 which computer 18 is a discrete computer system, input device 58 

17 also includes a keyboard and mouse-type controller. 

18 I/O Interface 62 is coupled to internal bus 66 and has an 



19 external port connector for coupling computer 18 with a host 

20 computer (not shown) for downloading image data stored in RAM 60 
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1 and/or flash memory 64. At the user's choice or when apparatus 10 

2 is completely filled with image data, I/O Interface 62 enables the 

3 image data to be down-loaded, thus freeing up storage space for 

4 future sets of image data. 



6 area and is preferably a non-volatile device, readily removable and 

7 replaceable by a user. Thus, a user who possesses several flash 

8 memories 64 may replace a full flash memory 64 with an empty flash 

9 memory 64 to effectively expands the picture taking capacity of 

10 apparatus 10. In the preferred embodiment of the present invention, 

11 flash memory 64 is a flash disk. Non-volatile memory 68 stores an 

12 image counter whose current value becomes an identifier for each 

13 new set of image data captured by apparatus 10. The counter is 

14 preferably incremented each time a new image is captured. In the 

15 preferred embodiment, non- volatile memory ' 68 is either an EEPROM 

16 or a battery-backed SRAM. 

17 Referring now to Figure 4, a block diagram of a preferred 

18 embodiment of RAM 60 is shown. RAM 60 is comprised of a frame 

19 buffer 70, a working memory 72 and a RAM disk 74. Frame buffer 70 

20 preferably comprises a dedicated space of contiguous memory 



5 



Flash memory 64 serves as an additional image data storage 
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1 suitable for storing the raw image data generated by image sensor 24. 

2 The function of frame buffer 70 is to store the most recently captured 

3 set of raw image data until computer 18 either stores the raw image 

4 data in RAM disk 74 or transfers it to an image processing unit. 

5 RAM disk 74 is a memory area within RAM 60 organized in a 

6 "sectored" format similar to that of conventional hard disk drives. The 

7 RAM disk 74 function is to store image data. RAM disk 74, in 

8 conjunction with flash memory 64, sets the maximum image holding 

9 capacity of apparatus 10. Once both flash memory 64 and RAM disk 
10. 74 have been filled with compressed image data, the insertion of a 

11 new flash memory 64 or down-loading the image data via I/O 

12 interface 62 will enable apparatus 10 to continue capturing new 

13 images. 

14 Working memory 72 is comprised of data cells 76, input queues 

15 78, storage status 80 and temporary buffer 81, each coupled via 

16 internal bus 66. Data cells 76 are data structures and each data cell 

17 76 is uniquely associated with particular captured image data. A 

18 data cell is comprised of a plurality of data fields including an image 

19 data identifier, a current location and processing requests. The image 

20 data identifier is of the preferred form "IMXXXXXX.YYY," where 
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1 "XXXXXX" is the image number retrieved from non-volatile memory 

2 68 and "YYY" is the image data file type. In the preferred 

3 embodiment, the image number "XXXXXX" is not reset, so when images 

4 are down-loaded to a host computer, image file identifiers will not 

5 conflict with image files previously down-loaded to the host computer. 

6 However, in an alternate embodiment the image number "XXXXXX" 

7 could be reset each time image data is down-loaded from apparatus 

8 10. Also the "IM" in the image identifier may be replaced with "10." 

9 The image data file type, "YYY," is preferably either CFA, JPG or PCT. 
1Q CFA refers to a set of raw image data and both JPG and PCT refer to a 

11 sets of compressed image data. 

12 The image data's current location data field stores either a "Raw 

13 Image Data In Frame Buffer" flag, a "Raw Image Data In RAM Disk" 

14 flag, a "Compressed Image Data In RAM Disk" flag, a "Raw Image Data 

15 In Flash memory" flag, a "Compressed Image Data In Flash memory" 

16 flag, or a "Compressed Image Data In Temporary Buffer" flag. The 

17 image data's processing request data field stores either a "Request 

18 Deletion Of Image Data" flag and/or a "Stop Processing Of Image Data" 

19 flag. Input queues 78 are data structures comprised of a plurality of 

20 data cell "pointers" each corresponding to data cells 76. In the 
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1 preferred embodiment, input queues operate on a first-in/first-out 

2 basis. 



4 available memory in both RAM disk 74 and flash memory 64. Storage 

5 status 80 contains the following four conditional variables: "RAM Disk 

6 Raw File Space," "RAM Disk Compressed File Space," "Flash Memory 

7 Raw File Space" and "Flash Memory Compressed File Space." Each of 

8 the four conditional variables is set to one of three values: FULL, 

9 ALMOST FULL or OK. If the variable is set to "OK," then space is 

1Q available for that particular file type (i.e., a raw file or a compressed 

11 file) on that particular storage resource (i.e., RAM disk 74 or flash 

12 memory 64). If the variable is set to "ALMOST FULL" then space is 

13 not currently available for that particular file type on that particular 

14 storage resource, but there will be space in the future. If the variable 

15 is set to "FULL" then, absent an increase in available space on storage 

16 resources (due, for example, to downloading data or replacing storage 

17 units), no space is available for that particular file type on that 

18 particular storage resource, nor will space be available in the future. 

19 Temporary buffer 81 of working memory 72 is provided for 

20 temporarily storing data and/or program code. 
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Storage status 80 is a data structure describing the remaining 
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Referring now to Figure 5, a block diagram of a preferred 



2 embodiment of ROM 56 is shown. ROM 56 preferably contains code 

3 for processes 82 through 96, including a control application (CA) 82, a 

4 RAM spooler 1 (RSI) -84, a flash memory spooler 1 (MSI) 86, image 

5 processing/compression (IPC) 88, a RAM spooler 2 (RS2) 90, a flash 

6 memory spooler 2 (MS2) 92, a file manager 94, and an operating 

7 system 96, each coupled via internal bus 66. In alternate 

8 embodiments, the Figure 5 processes 82 through 96 may be stored in 

9 various computer memory types other than ROM 56. 

10 A "spooler" is herein defined as a routine for transferring data 

11 from one process or device to a second process or device. RAM 

12 spooler 1 (84) transfers raw image data into RAM disk 74, and flash 

13 memory spooler 1 (86) transfers raw image data into flash memory 

14 64. RAM spooler 2 (90) transfers compressed image data into RAM 

15 disk 74 or to I/O interface 62, and flash memory spooler 2 (92) 

16 transfers compressed image data into flash memory 64. 

17 Control application 82 preferably comprises program 

18 instructions for controlling the operation of apparatus 10 which are 

19 executed using processing unit 54. For example, control application 82 

20 creates and maintains data cells 76. Image processing/compression 
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1 88 compresses the raw image data to maximize the image-carrying 

2 capacity of apparatus 10, and also processes the raw image data to 

3 permit readily displaying the captured image data on a host computer. 

4 In the preferred embodiment, processes 82 through 96 are comprised 

5 of a series of software steps implemented on top of a multithreaded 

6 operating system and may therefore run in parallel operation. 

7 Figure 6 is a block diagram showing a preferred embodiment of 

8 apparatus 10 for increasing a camera image capture rate. In Figure 6, 

9 frame buffer 70 receives and stores raw image data previously 

10- captured by imaging device 14. Frame buffer 70 then provides the 

11 raw image data via line 100 to rotate process 95 which is described in 

12 detail in co-pending U.S. Patent Application Serial No. 08/588,210, 

13 entitled "Apparatus and Method for Rotating the Display Orientation of 

14 a Captured Image," filed on January 19, 1996, which is hereby 

15 incorporated by reference. 

16 Process 95 rotates the captured image if necessary and then 

17 transfers control of the raw image data to RAM spooler 1 (84) using 

18 line 102. Alternately, if RAM disk 74 is full, rotate process 95 may 

19 transfer control of the raw image data directly to image 

20 processing/compression (IPC) 88 using line 118. If RAM spooler 1 
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1 (84) receives control of the raw image data, it then stores the raw 

2 image data into RAM disk 74 using line 104. 



4 RAM disk 74 via line 106 and store it into flash memory 64 using line 

5 108. Alternately, if flash memory 64 is full, RAM disk 74 may 

6 provide the raw image data directly to IPC 88 using line 114. If flash 

7 spooler 1 (86) stores the raw image data into flash memory 64, then 

8 IPC 88 typically accesses the stored raw image data using line 110 

9 and processes the raw data to responsively obtain compressed image 
1Q data. 

11 IPC 88 may bypass RAM spooler 2 (90) and store the 

12 compressed data directly to RAM disk 74 via line 115, or alternately, 

13 if RAM disk 74 is temporarily full, IPC 88 may write the compressed 

14 data to temporary RAM buffer 81 via line 85. RAM spooler 2 (90) 

15 may then access the compressed image data via line 87 and write the 

16 accessed data into RAM disk 74 via line 104. RAM spooler 2 (90) may 

17 also download the compressed image data to I/O interface 62 using 

18 line 116. Once the compressed data is in RAM disk 74, flash spooler 2 

19 (92) then accesses the data via line 106 and writes the compressed 

20 data into flash memory 64. 
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Flash spooler 1 (86) may then access the raw image data from 
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The present invention may thus process and store a sequence of 



2 captured images received from imaging device 14. Although the 

3 above example traces the typical data path for a single captured 

4 image, the present invention may readily operate on a plurality of 

5 captured images progressing through various stages of apparatus 10. 

6 Therefore, multiple sets of image data may exist simultaneously 

7 within computer 18. The current processing stage for a specific set of 

8 image data is preferably indicated by flags located in the image data's 

9 unique data cell 76. 

10 Figure 7 is a block diagram showing priority levels for processes 

11 84 through 92 of the preferred embodiment with corresponding 

12 image data routing paths. Background processes 84 through 92 are 

13 preferably allotted processing unit 54 time depending on their 

14 priority level. This priority level is related to the goal of rapidly 

15 emptying frame buffer 70 to enable rapid capture of successive sets 

16 of image data. 

17 Control application 82 transfers raw image data from imaging 

18 device 14 to frame buffer 70 and may supersede any of background 

19 processes 84 through 92. The background process with the highest 

20 priority is RAM spoolerl (84) which moves raw image data out of 
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1 frame buffer 70 to RAM disk 74. The second highest priority is flash 

2 memory spooler 1 (86) which moves raw image data out of RAM disk 

3 74 to flash memory 64. The third highest priority is Image 

4 Processing/Compression 88 which accesses raw image data and 

5 responsively processes and compresses the image data before storing 

6 it as compressed image data into RAM disk 74, or if RAM disk 74 is 

7 full, into temporary RAM buffer 81 of working memory 72. The 

8 fourth highest priority is RAM spooler 2 (90) which, if necessary, may 

9 move compressed image data out of working memory 72 into RAM 

10 disk 74. The lowest priority is flash memory spooler 2 (92) which 

11 moves the compressed image data out of RAM disk 74 into flash 

12 memory 64. Those skilled in the art will recognize that either a 

13 greater or a lesser number of priority levels than the preferred five 

14 may be used in the present invention. Also, alternate embodiments 

15 may establish different criteria for routing the captured image data, 

16 depending upon memory resources available and/or the maximum 

17 image capture rate desired. File manager process 94 and operating 

18 system process 96 are not assigned specific priority levels since they 

19 either operate in the background or under interrupt conditions. 
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Processes 82 through 92 preferably each has a respective input 



2 queue 78(a) through 78(f) which operates on a first-in/first-out basis. 

3 If one of processes 82 through 92 has a data cell 76 pointer in its 

4 input queue, then only that process can access and perform operations 

5 on the image data associated with that particular data cell 76. The 

6 data cell pointers are passed between processes 82 through 92 in a 

7 specific order until the original raw image data has been fully 

8 processed, compressed and stored in a memory resource. 

9 The priority level scheme introduced above may "block" one or 

10 more processes 84 through 92 even though a data cell 76 pointer is in 

11 its input queue 78. For example, since moving raw image data out of 

12 frame buffer 70 has the highest priority, if a user repeatedly captures 

13 images in rapid succession, RAM spooler 1 (84) will continue to operate 

14 until RAM disk 74 becomes filled with raw image data. While RAM 

15 spooler 1 (84) is operating, all of the other lower priority processes 86 

16 through 92 will be "blocked" (i.e., idled), even though some of the 

17 lower priority processes 86 through 92 may still have data cell 76 

18 pointers in their input queues 78. This blocking of lower priority 

19 processes applies to all priority levels. For example, operation of flash 

20 memory spoolerl (86) will block image processing/compression 88, 



m % 

1 RAM spooler 2 (90) and flash memory spooler 2 (92), and operation of 

2 image processing/compression 88 will block RAM spooler 2 (90) and 

3 flash memory spooler 2 (92), and so on, until the image data .has been 

4 fully processed, compressed and stored in memory. Furthermore, if a 

5 lower priority ROM process is currently operating and a higher 

6 priority ROM process requires processing unit 54, then the lower 

7 priority ROM process is immediately blocked until the higher priority 

8 ROM process has completed its operations. 

9 Figure 8 is a flowchart of preferred method steps for 

10. implementing RAM spooler 1 (84) according to the present invention. 

11 In step 200, processing unit 54 initializes RAM spooler 1 (84). RAM 

12 spooler 1 (84) waits 202 for a message or pointer on its input queue 

13 78. Once a message is received, RAM spooler 1 (84), determines 204 

14 whether a "stop processing" request is present by checking a 

15 corresponding request bit in data cell 76. If the "stop processing" 

16 request is present, step 206 returns data cell 76 to control application 

17 82 and returns the Figure 8 process back to step 202. If the request 

18 is not present, step 208 determines whether RAM disk 74 or flash 

19 memory 64 are available. If not available, step 210 sends the raw 
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1 image data directly to IPC 88 and returns the Figure 8 process back to 

2 step 202. 



4 determines whether the raw image data is stored in RAM disk 74. If 

5 the data is already stored in RAM disk 74, step 226 sends the raw 



7 step 202. If the data is not stored in RAM disk 74, step 214 

8 determines whether a "delete image" request is present by checking a 

9 corresponding request bit in data cell 76. If the request is present, 
10. step 216 releases frame buffer 70 to accept incoming raw image data 

11 from imaging device 14. Step 206 then returns data cell 76 to control 

12 application 82 and the Figure 8 process returns to step 202. If the 

13 "delete image" request is not present, step 218 determines whether 

14 there is (or will be) space on RAM disk 74 by checking storage status 

15 80, as described above in conjunction with Figure 4. If there is (or 

16 will be) space, step 220 waits for a "space available now" signal before 

17 step 222 creates the file to write on RAM disk 74. If step 218 

18 determines- that RAM disk 74 has no -space, then step 228 determines 

19 whether flash memory 64 has (or will have) space by checking 

20 storage status 80. If flash memory 64 has no space, an error condition 
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If RAM disk 74 or flash memory 64 are available, step 212 
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image data to flash spooler 1 (86) and returns the Figure 8 process to 
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1 exists. Step 230 therefore returns data cell 76 to control application 

2 82 and returns the Figure 8 process to step 202. If flash memory 64 

3 has (or will have) space, step 232 waits for a "space available now" 

4 signal before step 234 creates the file to write on flash memory 64. 

5 In step 224, the image is rotated if necessary, and RAM spooler 

6 1 (84) writes the raw image data to the created file arid releases 

7 frame buffer 70 to accept new incoming raw image data from imaging 

8 device 14. Step 226 transfers control to flash spooler 1 (86) and 

9 returns the Figure 8 process to step 202 to wait for another message 
1Q on its input queue 78. 

11 Figure 9 is a flowchart of preferred method steps for 

12 implementing flash spooler 1 (86) according to the present invention. 

13 In step 300, processing unit 54 initializes flash spooler 1 (86). In step 

14 302, flash spooler 1 (86) waits for a message on its input queue 78 

15 before advancing to step 304. Flash spooler 1 (86), in step 304, 

16 determines whether a "stop processing" request is present. If the 

17 request is present, step 306 returns data cell 76 to control application 

18 82 and returns the Figure 9 process back to step 302. 

19 If the request is not present, step 308 determines whether the 

20 raw image data is stored in flash memory 64. If the data is already 
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1 stored in flash memory 64, step 324 sends the raw image data to IPC 

2 88 and returns the Figure 9 process to step 302. If the data is not 

3 stored in flash memory 64, step 310 determines whether a "delete 



4 image" request is present. If the request is present, step 312 deletes 

5 the file in RAM disk 74. Step 306 then sends data cell 76 to control 

6 application 82 and the FIG. 9 process returns to step 302. If the 

7 "delete image" request is not present, step 314 determines whether 

8 the raw image data is stored in RAM disk 74. If the data is not stored 

9 in RAM disk 74, step 316 signals an error, returns data cell 76 to 
1Q control application 82 and returns the Figure .9 process back to step 



13 determines whether flash memory 64 has (or will have) space. If 

14 flash memory 64 has no space, step 324 sends data cell 76 to image 

15 processing/compression and then the FIG. 9 process returns to step 

16 302. If flash memory 64 has (or will have) space, step 320 waits for a 

17 "space available now" signal before flash spooler 1 (86), in step 322, 

18 copies the raw image data from RAM disk 74 to flash memory 64 and 

19 then deletes the file on RAM disk 74. Step 324 transfers control to 
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302. 
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If the raw image data is stored in RAM disk 74, step 318 
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1 IPC 88 and returns the Figure 9 process to step 302 to wait for 

2 another message on its input queue 78. 



4 implementing the image processing/compression 88 of the present 

5 invention. In step 400, processing unit 54 initializes IPC 88. In step 

6 402, IPC 88 waits for a message on its input queue 78 before 

7 advancing to step 404. IPC 88, in step 404, determines whether a 

8 "stop processing" request is present. If the request is present, step 

9 406 returns data cell 76 to control application 82 and returns the 

1Q Figure 10 process back to step 402. If the request is not present, step 

11 408 determines whether the image data is already compressed. If 

12 already compressed, step 422 sends the compressed image data to 

13 RAM spooler 2 (90) and returns the Figure 10 process to step 402. 

14 If the data is not compressed, step 410 determines whether a 

15 "delete image" request is present. If the request is present, step 412 

16 deletes the disk file or releases frame buffer 70 to accept incoming 

17 raw image data from imaging device 14. Step 406 then sends data 

18 cell 76 to control application 82 and returns the FIG. 10 process to 

19 step 402. If the "delete image" request is not present, step 414 

20 determines whether there is (or will be) space on RAM disk 74. If 
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Figure 10 is a flowchart of preferred method steps for 
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1 there is space, step 416 waits for a "space available now" signal before 

2 step 418 creates the file to write on RAM disk 74. If step 414 

3 determines that RAM disk 74 has no space, then step 424 determines 

4 whether flash memory 64 has (or will have) space. If flash memory 

5 64 has no space, step 426 creates a RAM 60 buffer to hold the image 

6 data. If flash memory 64 has (or will have) space, step 428 waits for 

7 a "space available now" signal before step 430 creates the file to write 

8 on flash memory 64. 

9 In step 420, IPC 88 processes and compresses the raw image 
1Q data and writes it to the appropriate destination (RAM disk 74, flash 

11 memory 64 or the RAM 60 buffer created in step 426) and then 

12 deletes the source file or releases frame buffer 70 to accept new 

13 incoming raw image data from imaging device 14. Step 422 transfers 

14 control to RAM spooler 2 (90) and returns the Figure 10 process to 

15 step 402 to wait for another message on its input queue 78. 

16 Figure 11 is a flowchart of preferred method steps for 

17 implementing RAM Spooler 2 (90) of the present invention. In step 

18 500, processing unit 54 initializes RAM spooler 2 (90). In step 502, 

19 RAM spooler 2 (90) waits for a message on its input queue 78 before 

20 advancing to step 504. RAM spooler 2 (90), in step 504, determines 
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1 whether the compressed image data is in the RAM 60 buffer created 

2 in step 426 (Figure 10). If not, step 522 sends the compressed data to 

3 flash spooler 2 (92) and returns the Figure 11 process to step 502. If 

4 so, step 506 determines whether a "stop processing" request is 

5 present. If the request is present, step 508 returns data cell 76 to 

6 control application 82 and returns the Figure 11 process back to step 

7 502. 

8 If the "stop processing " request is not present, step 510 

9 determines whether a "delete image" request is present. If the 

10 request is present, step 512 releases the RAM 60 buffer. If the 

11 "delete image" request is not present, step 514 determines whether 

12 there is (or will be) space on RAM disk 74. If there is (or will be) 

13 space, step 516 waits for a "space available now" signal before step 

14 518 creates the file to write on RAM disk 74, If step 514 determines 

15 that RAM disk 74 has no space, then step 524 determines whether 

16 flash memory 64 has (or will have) space. If flash memory 64 has no 

17 space, step 526 signals an error, returns data cell 76 to control 

18 application 82 and returns the Figure 11 process to step 502. If flash 

19 memory 64 has (or will have) space, step 528 waits for a "space 
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1 available now" signal before step 530 creates the file to write on flash 

2 memory 64. 

3 In step 520, RAM spooler 2 (90) writes the compressed image 

4 data to the created file and releases the RAM 60 buffer. Step 522 

5 transfers control to flash spooler 2 (92) and returns the Figure 1 1 

6 process to step 502 to wait for another message on its input queue 78. 

7 Figure 12 is a flowchart of preferred method steps for 

8 implementing the flash spooler 2 (92) of the present invention. In 

9 step 600, processing unit 54 initializes flash spooler 2 (92). In step 

10 602, flash spooler 2 (90) waits for a message on its input queue 78 

11 before advancing to step 604. Flash spooler 2 (92), in step 604, 

12 determines whether flash memory 64 is available. If not available, 

13 step 606 returns data cell 76 to control application 82 and returns the 

14 Figure 12 process to step 602. If flash memory 64 is available, step 

15 608 determines whether a "stop processing" request is present. If the 

16 request is present, step 606 returns data cell 76 to control application 

17 82 and returns the Figure 12 process back to step 602. 

18 If the request is not present, step 610 determines whether the 

19 compressed image data is stored in flash memory 64. If the data is 

20 stored in flash memory 64, step 612 returns data cell 76 to control 
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1 application 82 and returns the Figure 12 process to step 602. If the 

2 compressed data is not stored in flash memory 64, step 614 

3 determines whether a "delete image" request is present. If the 

4 request is present, step 616 deletes the file in RAM disk 74. Step 606 

5 then returns data cell 76 to control application 82 and returns the 

6 Figure 12 process to step 602. If the "delete image" request is not 

7 present, step 618 determines whether the compressed image data is 

8 stored in RAM disk 74. If the compressed data is not stored in RAM 

9 disk 74, step 620 signals an error, returns data cell 76 to control 

10 application 82 and returns the Figure 12 process to step 602. If the 

11 compressed image data is stored in RAM disk 74, step 622 determines 

12 whether flash memory 64 has (or will have) space. If flash memory 

13 64 has no space, step 620 signals an error, returns data cell 76 to 

14 control application 82 and returns the Figure 12 process to step 602. 

15 If flash memory 64 has (or will have) space, step 624 waits for a 

16 "space available now" signal before flash spooler 2 (92), in step 626, 

17 copies the compressed image data from RAM disk 74 to flash memory 

18 64 and then deletes the file on RAM disk 74. Step 612 then returns 

19 data cell 76 to control application 82 and returns the Figure 12 

20 process to step 602 to wait for another message on its input queue 78. 
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1 The present invention has been described above with reference to 

2 certain preferred embodiments, however, those skilled in the art will 

3 recognize that various modifications may be provided. Furthermore, 

4 while the present invention has been discussed above as applied to 

5 digital cameras, those skilled in the art will also recognize that the 

6 current apparatus and method may also be applied to other devices such 

7 as optical scanners and fax machines. These and other variations upon 

8 and modifications to the preferred embodiment are provided for by the 

9 present invention which is limited only by the following claims. 
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